Please type a plus sign (+) inside this box ^ | + | PTO/SB/21 (08-00) 

Approved for use through 10/31/2002. OMB 0651-0031 
U.S. Patent and Trademark Office: U.S. DEPARTMENT OF COMMERCE 
Under the Paperwork Reduction Act of 1995. no persons are required to respond to a collection of information unless it displays a valid OMB control number. 



r 

TRANSMITTAL 
FORM 

(to be used for all correspondence after initial filing) 


Aoolication Number 


m/fifift47i 


Filing Date 


Oct 16, 2003 


First Named Inventor 


Xie 


Group Art Unit 


2171 


Examiner Name 




^ Total Number of Pages in This Submission 




Attorney Docket Number 


MS1-1643US J 


ENCLOSURES fcheck all that aoolv) 


[~ ] Fee Transmittal Form 
[~j Fee Attached 

Amendment / Reply 
( ^] After Final 

] Affldavits/declaration(s) 

Q^J Extension of Time Request 

[ J Express Abandonment Request 

| y/ | Information Disclosure Statement 

r I Certified Copy of Priority 
I 1 Document(s) 

I I Response to Missing Parts/ 
I 1 Incomplete Application 

I I Response to Missing Parts 
I I under 37 CFR 1.52 or 1.53 


□ 
□ 


Assignment Papers 
(for an Application) 

Drawing(s) Sheets 
Licensing-related Papers 
Petition 

Petition to Convert to a 
Provisional Application 

Power of Attorney, Revocation 
Change of Correspondence 
Address 

Terminal Disclaimer 
| Request for Refund 

m i Niimhftrof m(s) 


I I After Allowance Communication 
I 1 to Group 

I I Appeal Communication to Board 
I I of Appeals and Interferences 

I I Appeal Communication to Group 

I I (Appeal Notice, Brief, Reply Brief) 

| ] Proprietary Information 

[~J Status Letter 

I / I Other Enclosure(s) (please 

I 1 identify below): 

Form 1449 & Copies of 36 Cited Non- 
Patent References 
Return Receipt Postcard 


Remarks 
Customer Num 


ber 22801 


SIGNATURE OF APPLICANT, ATTORNEY, OR AGENT 


Firm 
or 

Individual name 




Signature 


Bria^J^^^421 


Date 





r nFRTIFICATF OF MAIL INft 




I hereby certify that this correspondence is being deposited with the United States Postal Service with sufficient postage as first class mail in 
an envelope addressed to: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450 on this date: July 12, 2004 


TvDed or printed name 


Hope A. Charles i 


^ Signature C 




Date 





Burden Hour Statement: This form is estimated fl>\ake 0.2 hours to complete. Time will vary depending upon the needs of the individual case. Any comments 
on the amount of time you are required to complete this form should be sent to the Chief Information Officer, U.S. Patent and Trademark Office, Washington, 
DC 20231 . DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. 



2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



Serial No 10/688,471 

Filing Date October 16, 2003 

Confirmation No 3070 

Inventorship Xie et al. 

Applicant Microsoft Corporation 

Group Art Unit 2171 

Examiner 

Attorney's Docket No MS1-1643US 

Title: Automatic Browsing Path Generation to Present Image Areas with High 
Attention Value as a Function of Space and Time 



INFORMATION DISCLOSURE STATEMENT 

References -- See Attached Form PTO-1449 

REMARKS 

The citations listed, copies attached, are submitted in compliance with the 
duty of disclosure defined in 37 CFR §1.56. The Examiner is requested to make 
these citations of official record in this application. 




lee & Hayes, ?llc 



1 



07 1204 1149 Document! 




type a plus sign (+) inside this box 



Substitute for form 1449A/PTO 



INFORMATION DISCLOSURE 
STATEMENT BY APPLICANT 

(use as many sheets as necessary) 



Sheet 



1 



of 



Complete if Known 



Application Number 



Filing Date 



First Named Inventor 



Group Art Unit 



Examiner Name 



Attorney Docket Number 



10/688,471 



October 16, 2003 



Xie 



2171 



MS1-1406US 



+ 



U.S. PATENT DOCUMENTS 


Examiner 
Initials' 


Cite 
No. 1 


U.S. Patent Document 


Name of Patentee or Applicant 
of Cited Document 


Date of Publication of 
Cited Document 
MM-DD-YYYY 


Pages, Columns, Lines, 
Where Relevant 

Passages or Relevant 
Fioures Appear 


% , . Kind Cod© 2 
Number . x 
[If known) 






5,442,633 




Perkins et al. 


08/15/1995 








c con nco 
5,530,903 




Moore et at. 


06/25/1996 








5,625,877 




Dunn et al. 


04/29/1997 








5,642,294 




Taniguchi et al. 


06/24/1997 








5,659,685 




Williams et al. 


08/19/1997 








5,745,190 




loka 


04/28/1998 








5,751,378 




Chen et al. 


05/12/1998 








5,774,593 




Zick et al. 


06/30/1998 








5,801,765 




Gotoh et al. 


09/01/1998 








5,835,163 




Liou et al. 


11/10/1998 








5,900,919 




Chen et al. 


05/04/1999 








5,91 1 ,008 




Niikura et al. 


06/08/1999 








5,920,360 




Coleman Jr. 


07/06/1999 








5,959,697 




Coleman Jr. 


09/28/1999 








5,990,980 




Golin 


11/23/1999 








5,995,095 




Ratakonda 


11/30/1999 








6,462,754 




Chakraborty et al. 


10/08/2002 








2003/0152363 




Jeannin et al. 


08/14/2003 

































FOREIGN PATENT DOCUMENTS 


Examiner 
Initials' 


Cite 
No. 1 


Foreign Patent Document 


Name of Patentee or 
Applicant of Cited Document 


Date of Publication of 
Cited Document 
MM-DD-YYYY 


Pages, Columns, Lines, 
Where Relevant 

Passages or Relevant 
Figures Appear 


T» 


Kind Code 5 

Office 3 Number 4 (if known) 








EP 1 168 840 




Toshiba 


01/02/2002 












EP 1 213 915 




Sony UK 


06/12/2002 












GB 2 356 080 




Sony UK 


05/09/2001 





































































































































Examiner 




Date 




Signature 




Considered 





•EXAMINER: Initial if reference considered, whether or not citation is in conformance with MPEP 609. Draw line through citation if not in conformance and not 
considered. Include copy of this form with next communication to applicant. 



1 Unique citation designation number. 2 See attached Kinds of U.S. Patent Documents. 3 Enter Office that issued the document, by the two-letter 
code (WIPO Standard ST.3). 4 For Japanese patent documents, the indication of the year of the reign of the Emperor must precede the serial 
number of the patent document. 5 Kind of document by the appropriate symbols as indicated on the document under WIPO Standard ST. 16 if 
possible. 6 Applicant is to place a check mark here if English language Translation is attached. 

Burden Hour Statement: This form is estimated to take 2.0 hours to complete. Time will vary depending upon the needs of the individual case. Any comments on 
the amount of time you are required to complete this form should be sent to the Chief Information Officer, U. S. Patent and Trademark Office, Washington, DC 20231. 
DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for Patents, Washington. DC 20231. 



type a plus sign (♦) inside this box ■ 



+ 



Substitute for form 1449B/PTO 

INFORMATION DISCLOSURE 
STATEMENT BY APPLICANT 

(use as many sheets as necessary) 


Complete if Known ^ 


Application Number 


10/688.471 


Filing Date 


October 16. 2003 


First Named Inventor 


Xie 


Group Art Unit 


2171 


Examiner Name 




^Sheet 2 of 4 


Attorney Docket Number 


MS1-1406US 



NON PATENT LITERATURE DOCUMENTS 



Examiner 
Initials' 



Cite 
No. 1 



Include name of the author (in CAPITAL LETTERS), title of the article (when appropriate), title of the 
item (book, magazine, journal, serial, symposium, catalog, etc.), date, page(s), volume-issue number(s), 
publisher, city and/or country where published. 



AHMAD, SUBUTAI; "VISIT: A Neural Model of Covert Visual Attention" Advances in Neural 
Information Processing Systems, v. 4, 1991, pgs 420-427 



BALUJA et al.; "Expectation-Based Selective Attention for Visual Monitoring and Control of a Robot 
Vehicle" Robotics and Autonomous Systems, v. 22 no. 3-4, December 1997, pages 329-344 



CHEN et al.; "A Visual Attention Model for Adapting Images on Small Displays" ACM Multimedia 
Systems Journal, 2003 



CHERRY, STEVEN M.; "Pesky Home Networks Trouble cable Behemoths" IEEE Spectrum, April 
2002, pages 60-61 



DENG et al.;" Peer Group Filtering and Perceptual Color Image Quantization" Proceedings of IEEE 
International Symposium on Circuits and Systems, Vol. 4, 1999, pages 21-24 



GAMAZ et al.; "Robust scene-change detection in MPEG compressed domain" Electrical & 
Computer Engineering, 1998, pp. 95-99 



GU et al.; "Dissolve Detection in MPEG Compressed Video" IEEE, 1997, pp. 1692-1696 



HARGROVE, THOMAS; "Logo Detection in Digital Video" Math 100, 03/06/2001 
http://toonarchive.com/logo-detection/, 9 pages 



HELD, GIBERT; "Focus on Agere System's Orinoco PC Card" International Journal of Network 
Management, January 2002, pages 187-193 



http://www.fatalfx.com/nomad/ "NOMAD (No More Advertising)" February 17, 2003, 4 pages. 



DIVAKARAN et al.; "Video Summarization Using Descriptors of Motion Activity: A Motion Activity 
Based Approach to Key-Frame Extraction from Video Shots" Journal of Electronic Imaging, October 
2001, vol.10 n 4, pp 909-916 





Examiner 
Signature 




Date 

Considered 





•EXAMINER: Initial if reference considered, whether or not citation is in conformance with MPEP 609. Draw line through citation if not in conformance and not 
considered. Include copy of this form with next communication to applicant. 



1 Unique citation designation number. 2 Applicant is to place a check mark here if English language Translation is attached. 

Burden Hour Statement: This form is estimated to take 2.0 hours to complete. Time will vary depending upon the needs of the individual case. Any comments on 
the amount of time you are required to complete this form should be sent to the Chief Information Officer, U. S. Patent and Trademark Office, Washington. DC 20231. 
DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for Patents, Washington, DC 20231. 



Please type a plus sign (+) inside this box . 



+ 



Substitute for form 1449B/PTO 

INFORMATION DISCLOSURE 
STATEMENT BY APPLICANT 

(use as many sheets as necessary) 


Complete if Known ^ 


Application Number 


10/688.471 


Filing Date 


October 16. 2003 


First Named Inventor 


Xie 


Group Art Unit 


2171 


Examiner Name 




^Sheet 3 of 4 


Attorney Docket Number 


MS1-1406US J 



NON PATENT LITERATURE DOCUMENTS 



Examiner 
Initials* 



Cite 
No. 1 



Include name of the author (in CAPITAL LETTERS), title of the article (when appropriate), title of the 
item (book, magazine, journal, serial, symposium, catalog, etc.), date, page(s), volume-issue numbers), 
publisher, city and/or country where published. 



HENG et al.; "Post Shot Boundary Detection Technique: Flashlight Scene Determination" University of Western 
Australia, 1999, pp. 447-450 



JHA, UMA S.; "Wireless Landscape- Need for Seamless Connectivity" Wireless 
Personal Communications 2002 pages 275-283 



JING et al.; "An Effective Region-Based Image Retrieval Framework" From ACM Multimedia, 2002, 
28 pages 



LELESCU et al.; "Real-time Scene Change Detection on Compressed Multimedia Bitstream Based 
on Statistical Sequential Analysis" IEEE, 2000, pp. 1141-1144 



LI et al.; "Statistical Learning of Multi-View Face Detection" Proceedings of ECCV, 2002, 25 pages 



LIENHART, R. et al.; "On the Detection and Recognition of Television Commercials" 
University of Mannheim, 17 pages. 



LU, LIE et al.; "A Robust Audio Classification and Segmentation Method" Microsoft Research, 
China, 9 pages. 



LU, LIE et al.; "Content Analysis for Audio Classification and Segmentation" IEEE Transactions on 
Speech and Audio Processing, Vol. 10 No. 7, October 2002, pages 504-516. 



LU, LIE et al.; "Content-Based Audio Segmentation Using Support Vector Machines" IEEE, 2001, 
pages 956-959. 



MA et al.; "A User Attention Model for Video Summarization" Proceedings of ICIP, 2002 



MILANESE R. et al.; "Attentive Mechanisms for Dynamic and Static Scene Analysis" Optical 
Engineering, v34 no8, August 1995, pages 2428-2434 





Examiner 
Signature 




Date 

Considered 





•EXAMINER: Initial if reference considered, whether or not citation is in conformance with MPEP 609. Draw line through citation if not in conformance and not 
considered. Include copy of this form with next communication to applicant. 



1 Unique citation designation number. 2 Applicant is to place a check mark here if English language Translation is attached. 

Burden Hour Statement: This form is estimated to take 2.0 hours to complete. Time will vary depending upon the needs of the individual case. Any comments on 
the amount of time you are required to complete this form should be sent to the Chief Information Officer, U. S. Patent and Trademark Office, Washington, DC 20231. 
DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for Patents, Washington, DC 20231. 



Please type a plus sign (+) inside this box — > I + 



r 

Substitute for form 1449B/PTO 

INFORMATION DISCLOSURE 
STATEMENT BY APPLICANT 

(use as many sheets as necessary) 


Complete if Known ^ 


Application Number 


10/688,471 i 


Filing Date 


October 16. 2003 


First Named Inventor 


Xie 


Group Art Unit 


2171 


Examiner Name 




^Sheet 4 of 4 


Attorney Docket Number 


MS1-1643US J 



NON PATENT LITERATURE DOCUMENTS 


Examiner 
Initials' 


Cite 
No. 1 


include name of the author (in CAPITAL LETTERS), title of the article (when appropriate), title of the 
item (book, magazine, journal, serial, symposium, catalog, etc.), date, page(s), volume-issue number(s), 
publisher, city and/or country where published. 


T 2 






NIEBUR, E. et al.; "Computational Architectures for Attention" The Attentive Brain, Chapter 9, 1998, 
pages 163-186 








OTOOLE; "An MPEG-1 Shot Boundary Detector Using XIL Colour Histograms" Dublin City 
Universitv 1998 nn 1-7 








SADLIER, DAVID A.; "Automatic TV Advertisement Detection from MPEG Bitstream" Centre for 

ninital Virion Pmr*occinn7R*iQParr , h InQtitntei fnr Nptwnrk JL r^ommimi^atinn Fnn DiiHlin fNtv 
L^ILJIldl V IUCU i 1 ULCOOll ly/ nCOCdl Ul 1 IIIOlllULC IUI IMClWUIft Ot v^ui i n i iui iiogliui i u.iiy., UULMIIl v^iiy 

University, 12 pages. 








SAHOO P.K. et al.; "Threshold Selection Using a Minimal Histogram Entropy Difference" Optical 
Engineering, v36 no7, July 1997, pages 1976-1981 






- 


SANCHEZ, JUAN MARIA; "AudiCom: A Video Analysis System for Auditing Commercial 
Broadcasts" Computer Vision Center Departament d'lnformatica Universitat Autonoma de 
Barcelona, 5 pages. 








i bu i oUo J. r\. et ai., Modeling visual Attention via oeiective i uning Aniiiciai intelligence v/o 
1995 pgs 507-545 








WOLFE J. M. et al.; "Deploying Visual Attention: The Guided Search Model" Al and the Eye, 
Chapter 4, 1990, pages 79-103 








YEO et al.; "Rapid Scene Analysis on Compressed Video" IEEE, 1995, pp. 533-544 








YUSOFF et al.; "Video Shot Cut Detection Using Adaptive Thresholding" University of 
Surrey, 2000, pp. 1-10 








ZABIH, RAMIN; "A Feature-Based Algorithm for Detecting and Classifying Scene Breaks" Computer 
Science Department, Cornell University, 16 pages. 








ZADEH L. A.; "Probability Measures of Fuzzy Events" Journal of Mathematical Analysis and 
Applications, 23, 1968, pgs 421-427 








Examiner Date 
Signature Considered 



'EXAMINER: Initial if reference considered, whether or not citation is in conformance with MPEP 609. Draw line through citation if not in conformance and not 
considered. Include copy of this form with next communication to applicant. 



1 Unique citation designation number. 2 Applicant is to place a check mark here if English language Translation is attached. 



Burden Hour Statement: This form is estimated to take 2.0 hours to complete. Time will vary depending upon the needs of the individual case. Any comments on 
the amount of time you ana required to complete this form should be sent to the Chief Information Officer, U. S. Patent and Trademark Office, Washington, DC 20231. 
DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for Patents, Washington, DC 20231. 



